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Genetic algorithms: Evolving neural network ensembles for control problems 
David Pardoe, Michael Ryoo, Risto Miikkulainen 

June 2005 Proceedings of the 2005 conference on Genetic and evolutionary 
computation GECCO '05 

Publisher: ACM Press 

Full text available: ^g]pdf( 121.49 KB ) Additional Information: full citation , abstract , references , index terms 

In neuroevolution, a genetic algorithm is used to evolve a neural network to perform a 
particular task. The standard approach is to evolve a population over a number of 
generations, and then select the final generation's champion as the end result. However, 
it is possible that there is valuable information present in the population that is not 
captured by the champion. The standard approach ignores all such information. One 
possible solution to this problem is to combine multiple individuals fro ... 
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2 Ensemble Prunin g Via Semi-definite Programmin g j| 
Yi Zhang, Samuel Burer, W. Nick Street 

December 2006 The Journal of Machine Learning Research, volume i 
Publisher: MIT Press 

Full text available: ^ pdf(291.31 KB) Additional^lnforrhation: full citation , abstract 

An ensemble is a group of learning^nodels that jointly solve a problem. However, the 
ensembles generated by existing techniques are sometimes unnecessarily large, which 
can lead to extra memory usage, computational costs, and occasional decreases in 
effectiveness. The purpose of ensemble pruning is to search for a good subset of 
ensemble members that performs as well as, or better than, the original ensemble. This 
subset selection problem is a combinatorial optimization problem and thus findi ... 

3 Learning Classifier systems and other genetics-based machine learning: papers: 
^ Evolving ensemble of classifiers in random subspace 
^ Albert Hung-Ren Ko, Robert Sabourin, Alceu de Souza Britto 

July 2006 Proceedings of the 8th annual conference on Genetic and evolutionary 

computation GECCO '06 
Publisher: ACM Press 

Full text available: ^ pdfd 79.26 KB) Additional Information: full citation , abstract , references , index terms 



H 



http://portal.acm.org/results.cfm?coll=ACM&dl=ACM&CFID=21705031&CFTOKEN=9... 6/18/2007 



Results (page 1): +"neural network ensemble" + f, genetic algorithm" 



Page 2 of 3 



Various methods for ensemble selection and classifier combination have been designed to 
optimize the results of ensembles of classifiers. Genetic algorithm (GA) which uses the 
diversity for the ensemble selection could be very time consuming. We propose compound 
diversity functions as objective functions for a faster and more effective GA searching. 
Classifiers selected by GA are combined by a proposed pairwise confusion matrix 
transformation, which offer strong performance boost for EoCs. 

Keywords: combining classifiers, confusion matrix, diversity, ensemble of learning 
machines, fusion function, majority voting, pattern recognition 



Market-based recommendation: A g ents that compete for consumer attention 
Sander M. Bohte, Enrico Gerding, Han La Poutre 

November 2004 ACM Transactions on Internet Technology (TOIT), volume 4 issue 4 
Publisher: ACM Press 

Full text available- HI Ddf(61 6 32 KB) Add ' tiona ' Information: full citation , abstract , references , citings, index 
: terms 

The amount of attention space available for recommending suppliers to consumers on e- 
commerce sites is typically limited. We present a competitive distributed recommendation 
mechanism based on adaptive software agents for efficiently allocating the "consumer 
attention space," or banners. In the example of an electronic shopping mall, the task is 
delegated to the individual shops, each of which evaluates the information that is 
available about the consumer and his or her interests (e.g. keywor ... 

Keywords: ACE, agent-based computational economics, competitive multi-agent 
systems, electronic markets, learning agents, market-based programming, 
recommendation systems 



5 Nonlinear Boostin g Pro j ections for Ensemble Construction ^ 
Nicolas Garcfa-Pedrajas, Cesar Garcfa-Osorio, Colin Fyfe 

May 2007 The Journal of Machine Learning Research, volume 8 
Publisher: MIT Press 

Full text available: ^ pdf(10.56 MB) Additional Information: full citation , abstract 

In this paper we propose a novel approach for ensemble construction based on the use of 
nonlinear projections to achieve both accuracy and diversity of individual classifiers. The 
proposed approach combines the philosophy of boosting, putting more effort on difficult 
instances, with the basis of the random subspace method. Our main contribution is that 
instead of using a random subspace, we construct a projection taking into account the • 
instances which have posed most difficulties to previous ... 

6 Research track papers: A general framework for accurate and fast regression by data Q 
summarization in random decision trees 
Wei Fan, Joe McCloskey, Philip S. Yu 

August 2006 Proceedings of the 12th ACM SIGKDD international conference on 
Knowledge discovery and data mining KDD '06 

Publisher: ACM Press 

Full text available: ^) pdf(4.67 MB) Additional Information: full citation , abstract , references , index terms 

Predicting the values of continuous variable as a function of several independent variables 
is one of the most important problems for data mining. A very large number of regression 
methods, both parametric and nonparametric, have been proposed in the past. However, 
since the list is quite extensive and many of these models make rather explicit, strong yet 
different assumptions about the type of applicable problems and involve a lot of 
parameters and options, choosing the appropriate regression m ... 
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Keywords: decision trees, random, regression 

7 Cluster ens embles — a knowled ge reuse framework for combinin g multiple partitions Q 
Alexander Strehl, Joydeep Ghosh 

March 2003 The Journal of Machine Learning Research, volume 3 
Publisher: MIT Press 

Full text available' 1?) odf(842 50 KB) Additional Information: full citation , abstract , references , citin gs, index 
' terms 

This paper introduces the problem of combining multiple partitionings of a set of objects 
into a single consolidated clustering without accessing the features or algorithms that 
determined these partitionings. We first identify several application scenarios for the 
resultant 'knowledge reuse 1 framework that we call cluster ensembles. The cluster 
ensemble problem is then formalized as a combinatorial optimization problem in terms of 
shared mutual information. In addition to a direct ... 

Keywords: cluster analysis, clustering, consensus functions, ensemble, knowledge reuse, 
multi-learner systems, mutual information, partitioning, unsupervised learning 

8 Technical Correspondence: A neural net compiler system for hierarchical Q 
^ org anization 

^ Rajeev Kumar 

February 2001 ACM SIGPLAN Notices, Volume 36 issue 2 
Publisher: ACM Press 

Full text available: ^ pdf ( 954.76 KB ) Additional Information: full citation , abstract , references 

We present a language framework for handling arbitrarily complex neural computations. 
The software architecture - which we call an Artificial /Veural Network Compiler for 
Hierarchical Organization {ANCHOR) - facilitates network hierarchy and simpler sub- 
mappings. We define a Net Definition Language (NDL) which is implemented in object- 
oriented programming paradigm; a trained network is decompiled bac ... 

Keywords: compiler-decompiler, hierarchical networks, neural net definitions, neural 
programming language, superneuron 
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